COMBINATORICS ON PERMUTATION TABLEAUX OF TYPE A 

AND TYPE B 
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Abstract. We give two bijective proofs of a result of Cortoel and Nadeau. 
We find a generating function related to unrestricted columns of permutation 
tableaux. As a consequence, we obtain a sign-imbalance formula for permu- 
tation tableaux. We extend the first bijection of Corteel and Nadeau between 
permutations and permutation tableaux to type B objects. Using this type 
B bijection, we generalize a result of Lam and Williams. We prove that the 
bijection of Corteel and Nadeau and our type B bijection can be expressed as 
zigzag maps on the alternative representation. 



1. Introduction 

A permutation tableau is a relatively new combinatorial object coming from 
Postnikov's study of totally nonnegative Grassmanian |10]. As its name suggests, 
permutation tableaux are in bijection with permutations. Surprisingly, there is 
also a connection between permutation tableaux and a statistical physics model 
called partially asymmetric exclusion process (PASEP), see (21 [51 S]. Recently, 
several papers on the combinatorics of permutation tableaux have been published, 
see [11 131 HI HSl [13 • In this paper we study in more detail the combinatorics of 
permutation tableaux of type A and type B. 

A permutation tableau (of type A) is a Ferrers diagram with possibly empty rows 
together with a 0, 1-filling of the cells satisfying the following conditions: 

(1) each column has at least one 1, 

(2) there is no which has a 1 above it in the same column and a 1 to the left 
of it in the same row. 

See Figure [H for an example of a permutation tableau. The length of a permutation 
tableau is defined to be the number of rows plus the number of columns. We denote 
by VT{n) the set of permutation tableaux of length n. A of a permutation tableau 
is called restricted if there is a 1 above it in the same column. If a row has no 
restricted 0, then it is called unrestricted. 

Let {x)n denote the rising factorial, i.e. (a;)o = 1 and (a;)„ = x(x+l) ■ ■ ■ (x+n — 1) 
for n > 1. Note that (2)„_i = (1)„ = n! for n > 1. 

Using recurrence relations, Corteel and Nadeau [3l Proposition 1] proved the 
following: 

(1) E x"-(^)-iy'°P-(^) = (x + y)„_i, 

TeVr{n) 

where urr(T) is the number of unrestricted rows of T and topone(r) is the number 
of I's in the first row. In this paper we give two bijective proofs of p]). 
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Similarly to the definition of unrestricted row, a column of a permutation tableau 
is called unrestricted if it does not have a which has a 1 to the left of it in the 
same row. For T G VT{n), let urc(r) denote the number of unrestricted columns 
of T. Then we prove the following. 

Theorem 1.1. We have 



n>OTeVT{n) ■ ' ^ ' 



where 

Et{x) = Y,<t)n-lx". 

n>l 

There are two interesting special cases t — 2 and t = —1 of Theorem 11.11 as 
follows. 

Corollary 1.2. Let f{n) denote the number of connected permutations o/{l, 2, . . . , n}, 
see Section\3[for the definition. Then 

^ 2-^(^)=/(n + l). 

In Section [3] we also give a combinatorial proof of Corollary 11.21 
We define the sign of T G VTin) to be sign(T) = (-1)"'=(^). When t = -1 in 
Theorem ll.li we get the following sign-imbalance formula for permutation tableaux. 

Corollary 1.3. We have 



^ sign(T)= 2 

TeVr{n) 

We also consider the set VTB{n) of type B permutation tableaux of length n 
defined by Lam and Williams [Sj . Using a similar argument in 3 , Lam and Williams 
[SI Proposition 11.4] showed the following (see Section U for the definition of urr(T) 
and diag(r)): 

(2) = (1 + zT{x + l)„-i. 

Te-PrB(n) 

In this paper we find a bijection $b between the type B permutation tableaux 
and the type B permutations, which extends the first bijection, say <&, in 3 . Using 
this bijection we prove the following generalization of See Section 2] for the 
definition of urr(r), diag(T) and topg i(T). 

Theorem 1.4. We have 



E 



X 



urr(T)-lytopo.i(T)^diag(T) ^ ^ (^^ yy_^^ 



There is another representation of a permutation tableau which we call the al- 
ternative representation. It was first introduced by Viennot Mi and systematically 
studied by Nadeau [5]. Nadeau [5] found a seemingly different bijection between 
the permutation tableaux and the permutations using alternative forests. He also 
showed that despite their different descriptions his bijection is, in fact, the same as 
the bijection $ of Corteel and Nadeau [3]. We show that this bijection can also be 
described as a zigzag map on the alternative representation similar to the zigzag 
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Figure 1. A Ferrers diagram with labeled rows and columns. 

map on permutation tableaux in [15j . More generally, we show that our map $b can 
be described as a zigzag on the alternative representation for type B permutation 
tableaux. 

The rest of this paper is organized as follows. In Section[2]we recall the bijection 
$ and some properties of it. Then we give two bijective proofs of ([T]). In Section[3] 
we prove Theorem 11.11 and Corollaries 11.21 and 11.31 In Section U we define the 
bijection $b and prove Theorem ll.4l In Section [5] we describe $ and $b in terms 
of zigzag maps on the alternative representation. In Section [6] we suggest some 
open problems. 

2. Two BIJECTIVE PROOFS OF CORTEEL AND NADEAU'S THEOREM 

A Ferrers diagram is a left-justified arrangement of square cells with possibly 
empty rows and columns. The length of a Ferrers diagram is the sum of the number 
of rows and the number of columns. If a Ferrers diagram is of length n, then we label 
the steps in the south-east border with 1, 2, . . . , n from north-east to south-west. 
We label a row (resp. column) with i if the row (resp. column) contains the south 
(resp. west) step labeled with i, see Figure [T] We denote the row (resp. column) 
labeled with i by Row i (resp. Column i). The {i, j)-entry is the cell in Row i and 
Column j. 

For a permutation tableau T, the alternative representation of T is the diagram 
obtained from T by replacing the topmost I's with f's, the rightmost restricted O's 
with •(— 's and removing the remaining O's and I's, see Figured Here, by a topmost 
1 we mean a 1 which is the topmost 1 in its column. A rightmost restricted is 
similar. Note that we can recover the permutation tableau T from its alternative 
representation as follows. We fill each empty cell with a if there is an arrow 
pointing to it and with a 1 otherwise. And then we replace each f with a 1 and 
each •(— with a 0. It is easy to see that in the alternative representation of T there is 
no arrow pointing to another arrow and each column has exactly one f- Conversely, 
a filling of a Ferrers diagram with t's and •<— 's satisfies these conditions if and only 
if it is the alternative representation of a permutation tableau. 

Remark 2.1. Our definition of the alternative representation comes from alter- 
native tableaux introduced by Viennot |17j . An alternative tableau is obtained by 
deleting the first row of the alternative representation of a permutation tableau. Al- 
ternative tableaux have the nice symmetric property for rows and columns. Rather 
than using the term alternative tableau, we use the term alternative representa- 
tion to emphasize that we consider it as a permutation tableau. See ^9] for more 
information on alternative tableaux. 

We denote by Sn the set of permutations of [n] = {1,2,..., n}. 
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Figure 2. A permutation tableau T (left) and the alternative 
representation of T (right). 



In [3], Corteel and Nadeau found two bijections between permutation tableaux 
and permutations. We recall their first bijection $ : VT{n) Sn- Here we use the 
alternative representation. 

Given T G VT{n), we first set tt to be the word of labels of the unrestricted rows 
of T arranged in increasing order. For each column, say Column i, of T, starting 
from the leftmost column and proceeding to the right, if Row j contains a f in 
Column i and ii < ■ ■ ■ < v are the labels of the rows containing a 4— in Column 
i, we add ii, . . . ,ir,* in this (increasing) order before j in tt. Then $(T) is the 
resulting permutation tt. For example, if T is the permutation tableau in Figure [2j 
then 

(3) $(T) = 4, 6, 5, 2, 8, 3, 1, 9, 7, 12, 10, 11, 13. 

Corteel and Nadeau ,3: proved that $ : VTin) 5„ is a bijection by providing 
the inverse map. 

For now and later use we define the following terminologies. 

For a word w — wi . . . Wn of distinct integers, Wi is called a right-to-left maximum, 
or a RL-maximum, if Wi > Wj for all j 6 {i + 1, j + 2, . . . , n}. Similarly, Wi is called a 
right-to-left minimum, or a RL-minimum, if Wi < Wj for all j G {i + l,i + 2, . . . ,n}. 
Let Wij^ , . • . , be the RL-maxima of w with ii < i2 < ■ ■ • < ik- Note that ik — n. 
By the cycles of w according to RL-maxima, we mean the cycles 

[wi,.. .,WiJ, {w^, + l,. . . , W.J, . . . , {w^^_^+l, ...,W,J. 

We also define the cycles of w according to RL-minima in the same way. 

Corteel and Nadeau '3', Theorem 1] proved the first item and Nadeau [9j Theorem 
5.4] proved the second item in the following lemma. 

Lemma 2.1. For T G T'T{n) and n £ Sn with $(T) = tt, we have the following. 

(1) The labels of the unrestricted rows of T are exactly the RL-minima ofi:. 

(2) The labels of the columns containing a 1 in the first row of T are exactly 
the RL-maxima of the subword of it which is to the left of the 1 in tt. 

For example, the labels of the columns containing a 1 in the first row of T in 
Figure[2]are 3 and 8 which are the RL-maxima of the subword 4, 6, 5, 2, 8, 3 of $(r) 
in 0. 

Now we give two bijective proofs of the following theorem which is first proved 
by Corteel and Nadeau [3l Proposition 1] using a recurrence relation. In fact, in 
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Figure 3. The construction of T' from T. 



the first proof we give a bijection is between objects counted by the values of the 
polynomial evaluated at positive integers, whereas in the second proof we give a 
bijection between objects counted by the coefficients of the polynomials. 

Theorem 2.2. We have 

TeVT{n) 



First proof of Theorem Since both sides of the equation are polynomials in x 
and y, it is sufficient to prove this for all positive integers x and y. Assume x and 
y are positive integers and let iV = n + a; + y — 2. 

Given T e VT{n), we construct T' e VT{N) as follows. Firstly, we add y — 1 
rows and x — 1 columns to T by adding y — 1 south steps at the beginning and 
X — 1 west steps at the end. Secondly, we fill the first entries of the leftmost x — 1 
columns with t's, see Figure [31 

Let U be the set of labels of the columns of T containing a t in the first row 
and let L be the set of labels of the unrestricted rows of T except Row 1. Now 
consider all permutation tableaux obtained from T' by doing the following: (1) for 
each u ^ U, move the t in the {y,u + y — l)-entry to the {i,u + y — l)-entry for 
some I < i < y and (2) for each i G L, put a in the {£ + y — 1, j)-entry for some 
N — x + 2<j<Nordo nothing. See Figure [31 where the possible cells for t's and 
<— 's are colored yellow and green respectively. Clearly, there are a;Utr(r)-iytopone(T) 
such permutation tableaux for given T. Thus the number of permutation tableaux 
obtained in this way for all T S VT{n) equals the left hand side of the equation in 
the theorem. Moreover, it is easy to see that such permutation tableaux are exactly 
those in VT{N) satisfying the following properties. 

(1) Each integer 1 < i < j/ is the label of an unrestricted row. 

(2) Each integer N — x + 2<j<Nis the label of a column containing a t in 
the first row. 

By Lemma 12. 1[ Q G VT{N) satisfies the above two conditions if and only if in 
the permutation tt = $((5) G Sm the integers N, N — 1, . . . , N — x + 2,1,2, . . . ,y 
are arranged in this order. Since the number of such permutations is ^"^^^^7)?' ~ 
{x + y)„_i, we are done. □ 
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Second proof of Theorem \2.2l Let c(n, k) denote the number of permutations of [n] 
with k cycles. The following is well known, see [131 Proposition 1.3.4]: 



k=0 



c{n, k)x^ = x{x + 1) • • • (a; + n - 1). 



Substituting n and a; by n — 1 and x + y respectively in the above equation, we 
obtain 



i + j 



^c{n-l,i + j)i . jx'y^ = {x + y)n-i- 

Thus it is sufficient to show that the number of T G VT{n) with urr(T) — \ = i and 
topone(T) = j is equal to c[n — l,i + For such a permutation tableau T, 

let TT = <I>(T) and assume that tt is decomposed as air. By Lemma I^TTl the number 
of RL-minima of r is i and the number of RL-maxima of cr is j. Consider the set 
Ci of cycles of r according to RL-minima and the set C2 of cycles of a according 
to RL-maxima. Then Ci and C2 have i and j cycles respectively, and their union 
forms a permutation of {2,3,...,n} with i+j cycles. For any permutation of 
{2,3,..., n} with i+j cycles, there are ways to distribute them into Ci and 
C2. Since we can reconstruct r and a from Ci and C2, the number of tt = $(r) is 
equal to c(n - 1,1 □ 



3. Unrestricted columns and sign-imbalance 
Recall that urc(T) denotes the number of unrestricted columns of T. We define 

n>OTeVT(n) 

Then Theorem II. II is the same as the following. 
Theorem 3.1. We have 

\ + Et{x) 

I + {t - i)xEt{xy 

where 

St(a;) = ^n(t)„_i:r". 

n>l 

Proof. We will prove the following equivalent formula: 

(4) 1 + Et{x) = Pt{x) + {t~ l)xEt{x)Pt{x). 

Since the coefficients of in both sides are polynomials in t, it is sufficient to 
prove dU for all positive integers t. Assume that t is a positive integer. 

We use a similar argument as in the proof of Theorem l2.2l However, we will use 
the permutation tableau itself instead of the alternative representation. 

Given T G VT{n), let T' be the permutation tableau in VT{n + t—l) obtained 
from T by adding t — 1 south steps at the beginning, where the first t—1 rows (the 
added rows) have O's only. Now consider all permutation tableaux obtained from T' 
by replacing the first t — 1 O's with i O's and t—l — i I's for some 0<i<t— lin each 
column if it was an unrestricted column in T . Note that this replacement never 
violates the condition for a permutation tableau because we add I's only on top 
of an unrestricted column. Clearly, there are f^''^^^) such permutation tableaux for 
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Figure 4. The decomposition of Q. 



each T G VT{n). On the other hand, it is not difficult to see that these permutation 
tableaux are exactly those in VT{n + < — 1) satisfying the following conditions. 

(1) Each integer l<i<i— lis the label of an unrestricted row. 

(2) The integer t is the label of a row. 

(3) When we remove the first t ~ \ rows, we get a permutation tableau. 

Thus Pt{x) is the generating function for the number of P G VT{n+t—l) satisfying 
the above three conditions. 

By Lemma [2TT| P G VT{n + t — 1) satisfies the conditions (1) and (2) if and only 
if 1, 2, — 1 are RL-minima of tt and t is an ascent of tt for tt = ^{P) G Sn+t-i- 
Equivalently, l,2,...,i — 1 are arranged in this order and t is not immediately 
followed by any of 1, 2, . . . , t — 1 in tt. The number of such tt is equal to 

(n + t~iy. , , (n + i-2)! 

(t^\)\ ~ " 1) • - " • t(t + 1) • • . (t + n - 2) = n(t)„_i. 

Thus the left hand side of ^ is the generating function for the number of 
P G VT{n+t — l) satisfying the conditions (1) and (2). Since Pt{x) is the generating 
function for the number of P G VTin + t — 1) satisfying the conditions (1), (2), and 
(3), it is enough to show that {t — l)xEt{x)Pt{x) is the generating function for the 
number of P G VT{n + t — 1) satisfying the conditions (1) and (2), but not (3). 

Now consider Q G VT{n+t — l) satisfying the conditions (1) and (2), but not (3). 
We will decompose Q as shown in Figure S) Let Q' be the tableau obtained from Q 
by removing the first t — 1 rows. Then Q' must have at least one zero column. Let 
h be the label of the leftmost zero column of Q' . Since Q is a permutation tableau, 
in Q, Row t — 1 must have a 1 in Column b + t — 1. Moreover, by the condition for 
a permutation tableau, all cells to the left of the cells in zero columns of Q' have 
O's only. Then in Figure 21 Ti together with the part of the first t~l rows of Q to 
the left of Column 6 + t — 1 is a permutation tableau satisfying the conditions (1), 
(2), and (3), and Tq together with the part of the first t — 1 rows of Q to the right 
of Column 6 + t — 1 is a permutation tableau satisfying the conditions (1) and (2). 
Note that the length of Tq is at least 1 because the first step (a south step) of Tq 
exists, and the length of Ti may be 0. Since Column h + t — 1 contributes the factor 
{t — l)a;, we obtain that [t — l)xEt{x)Pt{x) is the desired generating function. □ 

For the rest of this section we study the special cases t = 2 and t = — 1 of 
Theorem 13.11 
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3.1. The case < = 2 : connected permutations. When t = 2 in Theorem 13. ![ 
we get the following. 



Corollary 3.2. We have 



P2{x) = 1 ( 1- ^ 



Proof. Since 



Ei{x) = J2 "-2^"' £^2(0;) = ^ n ■ nix'' = - — -Ei{x) - 1, 

n>l n>l 

by Theorem 13. 1[ we get 



P2ix) 



l + E2{x) ^Ei{x) 



l + x-E2{x) I + [1 - x)Ei{x) - X 

1 




□ 



A connected permutation is a permutation tt = tti • • • 7r„ G S'„ such that tt does 
not have a proper prefix which is a permutation, in other words, there is no integer 
k < n satisfying tti • • ■ tt^ G 5*^. Let f{n) denote the number of connected permuta- 
tions of [n]. It is known that J2n>o — {^n>o tt-^-x"^ , see [12]. Thus, 
by Corollary 13.21 we get the following. 



Corollary 3.3. We have 

2urc(T) ^ 



TeVT{n) 



Now we prove Corollary 13 . 31 combinatoriallv. To do this we introduce the follow- 
ing terminology. 

A shift- connected permutation is a permutation tt = tti ■ • • 7r„ G S'„ satisfying the 
following: if ttj — I, there is no integer i < j such that TTiiTi^i ■ ■ ■ nj G Sj-i-i-i. Note 
that if 7r„ = 1 then TT is not a shift-connected permutation because tti • • • tt^ G Sn • 

Proposition 3.4. The number of connected permutations of [n] is equal to the 
number of shift- connected permutations of [n]. 

Proof. Let CP(n) (resp. SCP(n)) denote the set of connected (resp. shift-connected) 
permutations of [n]. It is sufficient to find a bijection between Sn \ CP(n) and 
^„\SCP(n). 

Given tt = tti • ■ • 7r„ G \ CP(n), we define tt' G \ SCP(n) as follows. Since 
TT is not a connected permutation, we can take the smallest integer k < n such that 
(7 = TTi ■ ■ ■ TTk G Sk- We decompose tt as tt = aT{k -\- l)p. Define tt' — ra'^lp where 
(T+ — 7rj!"7r^_-^ • ■ • with = tt^ -f 1 for i G [k]. It is easy to see that tt 1— tt' is a 
bijection between Sn \ CP(n) and Sn \ SCP(n). □ 
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The following proposition gives us a relation between permutation tableaux and 
shift-connected permutations. 

Proposition 3.5. Let T G T'l'{n) and tt — $(T). Then T has a column which has 
a 1 only in the first row if and only if n is not a shift- connected permutation. 

Proof. Assume that T has a column which has a 1 only in the first row. Then, in 
the alternative representation, T has a column, say Column d, which has a t in the 
first row and each cell except the topmost cell in the column has a <— in the cell or 
pointing to it. We will refer this condition as (*). 

Recall the bijection $. To construct tt — $(r) we first let tt be the word 
consisting of the labels of the unrestricted rows of T arranged in increasing order. 
Then starting from the leftmost column we add some integers to tt. Assume that 
we have proceeded just before Column d. We can decompose tt as air at this 
stage. By the condition (*), neither a nor r has an integer i with 2 < i < d. When 
we continue the construction of $, by the condition (*) again, no integer i with 
2 < i < d is added before the last integer of a or after 1. Thus at the end we must 
have <i>(T) = tt = (rplr, which implies that pi G Sd- Thus tt is not a shift-connected 
permutation. 

Conversely, assume that tt is not a shift-connected permutation. Then we can 
decompose tt as aplr such that pi G Sd for some d. We claim that Column d in 
T has the condition (*). Since d is the largest integer in p, it is a RL-maximum 
in a p. Thus Column d in T has a t in the first row by Lemma l2. II If there is an 
unrestricted row with label 1 < i < d, then i is a RL-minimum of r contradicting 
to pi G Sd. Hence, it remains to show that there is no row with label 1 < i < d 
having a <— in a column with label d' > d. Suppose there is such a row. We can 
assume that i is the smallest integer satisfying this condition. Let i' be the label or 
the row containing the unique f in Column d' . Since !<«'<«, we must have i' = 1 
because otherwise Row i' satisfies the above condition which is a contradiction to 
the minimality of i. Thus Column d' has a f in the first row. By Lemma [2T] d' is 
a RL-maximum of err. Since Row i has a ■<— in Column d' , we must have i before 
d' in TT. Since both d and d' are RL-maxima of ctt and d' > d, we have d' before 
d. Thus the integers i,d',d appear in this order in tt. This is a contradiction to 

pi e Sd. □ 

Using the argument in the proof of Theorem l3.1l one can easily see that J^TeVTin) 2"'''^(-^^ 
is the number of T G 'PT{n + 1) without a column containing a 1 only in the first 
row. Thus, by Proposition 13. 51 we get the following. 

Proposition 3.6. The number of shift- connected permutations of [n -\- 1] is equal 
to 

TGVr{n} 

Combining Propositions 13.41 and 13.61 we get a combinatorial proof of Corol- 
lary E31 

3.2. The case t — —1 : sign-imbalance. When t — ~1 in Theorem 13. 1[ we get 
the following. 

Corollary 3.7. We have 
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Figure 5. The shifted Ferrers diagram F for the Ferrers diagram 
F in Figure [T] 



Proof. Since £'_i(x) — x — 2x'^, we obtain 

l + E^i{x) _ l + x-2x^ 



P-i(x) 



1-x 



l-2x-E^i{x) l-2a;2 



4x3 



1 - 2.x + 2x2 ' 



□ 



Recall that sign(r) = for T £ VT{n). Since 

l-x I f I 1 

P-i[x) 



l~2x + 2x'^ 2 \l~{l + i)x l-{l-i)xj' 
we get the following sign-imbalance formula for permutation tableaux. 

Corollary 3.8. We have 

(l + i)" + (l-z)" 



(6) 



E sign(r) = 

TeVT{n) 



Equivalently, if n — Ak -\- r for < r < 4, then 

( . 22*;, ifr^Oorr^l, 

sign(T)= <^ 0, z/r-2, 
TeVTin) \^ ^_i-jk+i , 2^k+i ^ ifr = 3. 

4. Type B permutation tableaux 

For a Ferrers diagram F with k columns, the shifted Ferrers diagram of F, 
denoted F, is the diagram obtained from F by adding k rows of size 1, 2, . . . , fc 
above it in increasing order, see Figure [S] The length of F is defined to be the 
length of F. The diagonal of F is the set of rightmost cells in the added rows. A 
diagonal cell is a cell in the diagonal. We label the added rows as follows. If the 
diagonal cell of an added row is in Column i, then the row is labeled with —i. 

A type B permutation tableau of length n is a shifted Ferrers diagram F of length 
n together with a 0, 1-filling of F satisfying the following conditions (see Figure IH): 

(1) each column has at least one 1, 
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Figure 6. A type B permutation tableau T (left) and the alter- 
native representation of T (right). 



(2) there is no which has a 1 above it in the same column and a 1 to the left 
of it in the same row, 

(3) if a is in a diagonal cell, then there is no 1 to the left of it in the same 
row. 

Note that the condition (3) above means that if we add the copy of the tableau 
below the diagonal cells reflected about the diagonal line to get a symmetric tableau, 
the condition (2) still holds. 

We denote by VTB{n) the set of type B permutation tableaux of length n. For 
T E PTb (n) , we say that a is restricted if it has a 1 above it in the same column 
or it is in a diagonal cell. If a row of T docs not contain any restricted 0, it is called 
an unrestricted row. 

The alternative representation of T G VTB{ri) is the diagram obtained from T 
as follows. Firstly, we replace the topmost I's with f's and the rightmost restricted 
O's with ■(— 's and remove the remaining O's and I's. Secondly, we remove the t's in 
the diagonal and cut off the diagonal cells as shown in Figure El Note that in the 
alternative representation of T G VTB{ri), there is no arrow pointing to another 
arrow. Here we consider the cutting segment as a mirror, that is, an arrow f in 
Column m is pointing to not only the cells above it in Column m but also the 
cells in Row —to. Conversely, for any diagram D satisfying this condition, we have 
T S VTBin) whose alternative representation is the diagram D. In contrast to 
the alternative representation of a permutation tableau, we may have a column 
without a t, which is in fact hidden in a diagonal cell. We note that the alternative 
representation of T G VTB{n) is in fact a half of a symmetric alternative tableau 
in [9j Section 3.5]. 

From now on, we will only consider the alternative representation unless other- 
wise stated. Note that Row i is unrestricted if and only if Row i has no and 
Column \i\, if it exists, has no t- 
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A type B permutation of [n] is a permutation of [n] in which each integer may 
be negated. For example, 4, —1, 2, 5, —3 is a type B permutation of [5]. We denote 
by Bn the set of type B permutations of [n] . 

Now we define a map $b '■ VTB{n) Bn. Let T e VTB{n). Suppose T has k 
columns labeled with ci < C2 < • • • < c^. We set 71^*^+^^ to be the word of labels 
of the unrestricted rows of T arranged in increasing order. For i from fc to 1, we 
define tt^*) to be the word obtained from 7r^'+^) by adding some integers as follows. 
If Column Ci has a t, let rg be the label of the row containing the t and add Ci 
before ro in 7r(*+^'. If Column a has no t, then do nothing (in this case —a should 
be already in 7r(*+^^). If ri < • ■ • < are the labels of the rows containing a <— in 
Column Ci, we add ri, . . . , in this (increasing) order before Ci or —Ci in tt. We 
define $3(7") = vr'^^^. For example, if T is the permutation tableau in Figure HI 
then 

(7) $b(T) = 9, 7, 10, 6, 2, 1, -3, 5, -8, 4, 11. 

The map $b : ^7~b("-) Bn is a generalization of $ : VT{n) — > 5„ in the sense 
that if T £ 'P7'b('t-) bas no diagonal 1, then we can consider T as an element in 
VTin) and the map $b on such T is identical with 

Proposition 4.1. The map $b ■ 'PTsin) Bn is a bijection. 

We will prove Proposition 14 . 1 1 by constructing the inverse of $b- In order to do 
this we need the following definitions. For tt = 7ri7r2 • • • 7r„ G _B„ and i G [ri], we say 
that TTi is a descent of tt if tt^ > tt^+i, and an ascent otherwise, where 7r„+i = n + 1. 
Note that our definition is different from the usual one which uses the index j as a 
descent or an ascent instead of the value Tr^. We also say that tt^ is a signed descent 
of TT if TTi < or TTj > ItTi+iI, and a signed ascent otherwise. The shape of tt is the 
shifted Ferrers diagram such that Itt^I is the label of a column if and only if tt^ is 
a signed descent of tt. For example, the shape of the type B permutation in ([7]) is 
the same as the shape of the type B permutation tableau in Figure [S] 

Now we define a map ^'b : Bn ^ 7'7~b('^)- Given tt = 7ri7r2 • • • 7r„ G Bn, we first 
set T to be the empty tableau with the same shape as vr. Let 7Tdi,TTd2^ ■ ■ ■ 1 ""dfc be 
the signed descents of tt with \ndi \ < iTTdj] < • • • < Let tt^^' = tt. For i from 

1 to k, we define tt'^'"'"^^ using n^'^^ as follows. During the process, we will fill the 
cells in Column Itt^. | of T. Suppose tt^*) ~ cri02 ■ ■ ■ erg and tTc;. = ad- 
Case 1: li ad < 0, let r be the smallest integer with ad < ar < ar+i < ■ ■ ■ < 

ad-i < \ad\- We fill the (o-j, |CTd|)-entry with a <— for each r < j < d — 1. 

Then tt*^*"*"^) is the word obtained from tt^*'' by removing aj for all r < j < 

d-1. 

Case 2: If ad > 0, then we have ad > \crd+i\ because Wdi = ad is a. signed 
descent of tt*^*^ (this will be proved in Lemma [4.2p . Let r be the smallest 
integer with ad+i < ar < ar+i < ■ ■ ■ < crd-i < <7d- We fill the {ad+i,ad)- 
entry with a t and the {aj , cr£;)-cntry with a <— for each r < j < d~l. Then 

^(^+1) is 

the word obtained from tt*-*-* by removing aj for all r < j < d. 

Repeat this process until we get 7r*^'^+^-' and define ^'B(7r) to be the resulting tableau 
T. For example, if tt is the permutation in ([7]), then 5'B(7r) is the permutation 
tableau in Figure [6] From the construction of vPb it is easy to see that 7r('^+^) 
consists of the integers which are the labels of the unrestricted rows of 4'B(7r). 

Lemma 4.2. Following the notations in the definition o/^B; we have the following. 
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(1) For each i £ [k], Tr^. is a signed descent in n^^K 

(2) 7r*^'^+^) is the word of the RL-minima of tt arranged in increasing order. 

Proof. (1) It is enough to show the following: for j < i, when we go from tt^^^ to 
7r(J+i)^ TT^, is not deleted and it remains a signed descent. First observe that we 
have < Itt^J by definition. Since we only delete integers between — Itt^j I and 
\ndj\, ■ndi is not deleted. If iidi < 0, it is a signed descent. Otherwise, the integer 
to the right of Tr^i may change. In this case, however, the integer to the right of 
TTdi TT^-''^^^ is smaller than lirdj] by the construction of ^E'b. Thus tt^; remains a 
signed descent in 7r^^+^'. 

(2) Similarly, we can prove the following. 

• For an integer g in 7r^'^\ g is a descent in tt*^*^ if and only if g is a descent in 

TT. 

• 77*^*^+^^ does not have any descent of tt. 

• tt'^'^'^^^ contains all RL-minima of tt. 

Using the above three statements one can easily derive (2). □ 

By Lemma 14.21 tt*^''^^) is the RL-minima of tt arranged in increasing order and 
these integers are the labels of the unrestricted rows of T = ^'3(71'). Now it is easy 
to see that ^b{T) = tt. Hence we obtain that the map : 'PTb(«) — >■ Bn is a 
bijection with inverse 4>g^ = \1/b. This completes the proof of Proposition 14. II 

Now we will find some properties of $b analogous to $. 

Let T £ VTB{n) and let Row m be the topmost unrestricted row of T. We 
denote by diag(T) the number of columns without a by urr(T) the number of 
unrestricted rows and by topQ ^ (T) the number of arrows in Row m and Column 
|m|. Equivalently, in the original permutation tableau representation diag(T) is 
the number of diagonal cells containing a 1 and topp i{T) is the number of I's in 
Row m except the 1 in the diagonal cell, if it exists, plus the number of rightmost 
restricted O's in Column |m|. Note that if m > 0, then we must have m = 1 and 
topg i(T) is simply the number of I's in Row 1. 

Example 4.1. Let T be the type B permutation tableau in Figure H) Then the 
topmost unrestricted row of T is Row —8 and diag(T) = 2, urr(r) = 3 and 
topoi(r) = 1 + 2 = 3. 

The following is a type B analog of Lemma 12.11 

Proposition 4.3. Let T e 7^7~b("-) and tt = <^-q{T) with tt decomposed as tt = 
armp, where min(7r) = m, the last element of a is greater than \m\ and each 
element of t is smaller than \m\. Then we have the following. 

(1) Row m is the topmost unrestricted row ofT. 

(2) Column t has no t if cmd only if —t appears in tt. 

(3) The labels of the unrestricted rows of T are exactly the RL-minima of tt . 

(4) The labels of the columns ofT with a^ in Row m are exactly the RL-maxima 
of a. Here a can be empty. 

(5) The labels of the rows ofT containing a in Column \m\ are exactly the 
RL-minima of t. Here r can be empty. 

(6) We have neg(7r) = diag(T). 

Proof. Let T have k columns labeled with ci < C2 < ■ ■ ■ < Ck- Using the notations 
in the definition of $b, we can observe the following. 
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Observation: When we obtain tt^*' from 7r(*+i), we add an increasing sequence 
of integers ai < ■ ■ ■ < as before b for some integers ai, . . . , a^, 6 satisfying b < as < 

C-i. 

Then (2) is obvious from the definition of $b and (3) follows from the fact that 
we do not create any new RL-minimum when we obtain tt^'^ from tt*^*'^^' by the 
above observation. Since the label of the topmost unrestricted row is smaller than 
that of any other unrestricted row, by (3) we obtain (1). 

Now we prove (4) and (5). Let t be the integer with ct = \m\ if m < and 
t = k + 1 ifm = 1. Since tt^'^"''^^ is the word of the RL-minima of tt arranged in 
increasing order, the first element of tt'-'^^^' is to. Thus for each i S [A: + 1] we can 
decompose tt*^*' as tt^'^ = cr^^V^'^mp^'^ where the last element of o'^'-' is greater than 
|to| and each element of t^'^ is smaller than |to|. 

Using the observation, it is not difficult to see that RLmax(o'(')) = RLmax((T*^'+^-')U 
{\ci\} if Column \ci\ has a t in Row m, and RLmax(cr(*') = RLmax((T'^*+^^) other- 
wise. Thus we get (4). Using the observation again, one can also easily see that 
^(fc+i) _ ^(fc) — ... — -^(t-i) — 0^ T-(t) ig i^j^e increasing sequence of labels of the 
rows of T containing a in Column |to| and RLmin(r(*^) = RLmin(r*^*~^)) = • • • = 
RLmin(r(i)). Thus we get (5). 

From the construction of <1>b, (6) is obvious. □ 

Now we are ready to prove the following theorem. 
Theorem 4.4. We have 

^ ^urr(T)-l^top„,,(T)^diag(T) ^ ^ ^ 

Note, if z = 0, the above theorem reduces to Theorem 12.21 by identifying a 
permutation tableau with a type B permutation tableau without any diagonal 1. 
We give two proofs of this theorem. These are type B analogs of the two proofs of 
Theorem [221 

First proof of Theorem \4.4\ We consider x and y as positive integers. Let N = 
n + X + y — 2. Note T G VT^{n) with diag(T) — can be considered as an element 
in VT{n) . Thus by Theorem 12.21 the left hand side of the formula is equal to 

(8) (x + y)„_i+ x"-(^)-iy'°Po,im^diag(T)^ 

diag(T)5iO 

Given T e PTnin) with diag(T) ^ 0, we define T' e PTb{N) as follows. Let 
Row TO be the topmost unrestricted row of T. Since diag(T) ^ we have m < 0. 
Then T' is obtained from T by inserting y — I columns to the left of Column |m|, 
y — 1 rows above Row m and x — 1 columns at the end, where the new x — 1 cells 
attached to the left of Row to are fill with t's as shown Figure [T] 

As we did in the first proof of Theorem 12.21 we can move each arrow in Row to 
(resp. Column |to|) to one of the y — 1 cells above it (resp. to the left of it), and we 
can place a <— in one of the x — 1 cells to the left of each unrestricted row, except 
Row TO. Let X{T) denote the set of type B permutation tableaux obtained in this 
way. Clearly X{T) has a;""(r)-iytopo.i(T) gigments and for each Q e X{T) we have 
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X-1 



Figure 7. Expansion 

^diag(Q) ^ ^diag(T)+y-l^ rpj^^^ p ^^^^j 

(9) {x + y)n-i+ E z^'-^^'^^-y+K 

tspTbC") Qex(T) 

diag(T)5^0 

On the other hand, one can check that Q G X{T) for some T G PTb("-) with 
diag(T) 7^ if and only if Q satisfies the foUowing conditions. Let Row M be the 
topmost unrestricted row of Q. 

• We have M < ~y and \M\ <N + x-l. 

• Row r is unrestricted for all r with M < r < M + y — 1. 

• Column c has a t in Row M for all c with A^-x + 2<c<A^. 

Now let TT = $b(Q) G Sjv- By ProDOsition l4.3[ Q satisfies the above conditions if 
and only if M — min(7r) < — y, | Af | < N + x — l and the integers N, N — 1, . . . , N ~ 
X + 2, M, M + l,...,M + y — 1 are arranged in this order in tt. Suppose tt G -B„ 
satisfies these conditions. Let A C [N] be the set of integers a such that tt has —a. 
Since N,N — 1, . . . , N — x + 2 appear in tt, we must have Ac [n + y — 1]. Since 
M < —y and M, M + l,...,M + y — 1 appear in tt, the largest y elements in A are 
consecutive. Let A' be the set obtained from A by deleting the largest y—1 elements. 
Then ^ ^ A' C [n]. Note that we can reconstruct A from A'. When A' is fixed, the 
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number of such tt G Bn is equal to f^^^^'^-^^y^ — (a; + j/)„-i- Since diag((5) — neg(7r), 
the number of negative integers in tt, and neg(7r) = |j4| = \A'\ + y — 1, we obtain 
that ([9]) is equal to the following which finishes the proof: 

{x + y)n-i+ V + = (l + z)"(x + y)„_i. 



07^A'C[ri 



□ 



Second proof of Theorem \4.4\ Let T e VTsin) and tt = $b(7')- We decompose tt 
as TT = <7Tmp, where m = min(7r), the last element of a is greater than \m\ and all 
the entries in r are smaller than \m\. Then by Proposition 14. 3[ diag(r) = neg(7r), 
urr(r) — 1 = RLmin(p), topg i(T) — RLmax(cr) + RLmin(r), where for a word 
w of integers, RLmin(ii;) (resp. RLmax(ii;)) denotes the number of RL-minima 
(resp. RL-maxima) of w. Thus 
(10) 

^urr(T)-lytop(, i(T)^diag(T) ^ ^ ^nog(7r)^RLmin(p) yRLmax(<T)+RLmin(r ) _ 

On the other hand, consider the set Ci (resp. C2 and C3) of cycles of a (resp. r 
and p) according to RL-maxima (resp. RL-minima and RL-minima). Then 

^nog(7r)^RLmin(p)^RLmax((T)+RLmin(r) ^ ^ncg(7r) ^|C3 | ^|Ci | + 1 C2 1 

Note that tt is determined by the ordered triple (Ci,C2,C3) and m. Moreover, 
since each cycle in Ci contains at least one integer greater than |m| and no cycle 
in C2 has this property, tt is determined by the ordered pair (Ci U C2, C3) and m. 
Let us fix the set A C [n] of integers a such that tt has —a. Note that A determines 
the set S of integers in tt and m = min(S'). Since (Ci U C2) U C3 is the set of cycles 
of a permutation on 5 \ {to}, the right hand side of ([T0| is equal to 



^ zl^l^c(n~l,z + j) 



i + j 
i 



I 7 
X y\ 



which is equal to (1 -I- z)^{x -f y)n-i as we have shown in the second proof of 
Theorem [231 □ 



5. Zigzag maps 

Steingrfmsson and Williams [TS] defined the zigzag map (^p°'™ : VT{n) — > Sn 
on permutation tableaux as follows. A zigzag path on a permutation tableau T G 
VT(ri) is a path entering from the left of a row or the top of a column, going to the 
east or to the south changing the direction alternatively whenever it meets a 1 until 
exiting the tableau, see Figure [8] Then (^P<^''™(r) is defined to be the permutation 
TT = TTi ■ • ■ 7r„ where tt^ = j if the zigzag path starting from Row i or Column i exits 
T from Row j or Column j. It is easy to see that (^p'^™(T) is a permutation of [n]. 

Steingrfmsson and Williams (TS] showed that the map (^p*""™ : VT{n,) — )■ Sn is in 
fact a bijection preserving many interesting statistics. Similarly, we can define the 
zigzag map C**" ■ VTin) Sn on the alternative representation in the same way: 
whenever we meet an arrow we change the direction, see Figure [5] 

In this section we show that C'^'* is essentially the same as the first bijection 
$ : VTin) Sn of Corteel and Nadeau [3]. 
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Figure 8. Zigzag paths on a permutation tableau T (left), on the 
alternative representation of T (middle) and on the bare represen- 
tation of T (right). 



Given T e VT{n), we can consider C^*{T) as a product of cycles as follows. 
Assume that T has k columns with labels Ci < C2 < • • • < . Note that each 
column has exactly one t and may have several •(— 's. For each Column Ci let Ci 
be the cycle (rf 



(i) 
: ''2 I ■ 



„(0 



Ci, f'o*'') where r^^'' is the label of the row containing 

(i) (i) (i) 

the unique t in Column and < < ■ ■ ■ < r^/ are the labels of the rows 
containing a ^ in Column a. It is easy to see that C^"(r) is equal to the cycle 
product C1C2 • • ■ Cfc. For example, if T is the permutation tableau in Figure [51 
then 

C^\T) = (3, 1)(5, 2)(4, 6, 2)(2, 8, 1)(9, 7)(12, 10). 

Let 7r(*) = CiC,+i---Ck for i e [k + 1]. Thus tt^^) is equal to C^*{T) and 
^(fc+i) jg -j-jj^g identity. We represent tt*^*) as a product of cycles as follows. First 
we represent tt^*"'"*"^' = (mi){m2) ■ ■ ■ (ms) where mi < m2 < ••■ < nis are the 
labels of the unrestricted rows of T. For each i G [fc], we represent tt^'^ using the 
representation of tt'-*''"^^ as follows. From the construction it is easy to see that 



among the elements in the cycle Ci = {r 



1 > ' 2 > ■ 



r^*\ci,ro''), ''0''' is the only 



integer which appears in the cycle product representation of n^-^^-^K Note that for 
different integers oi, . . . , a^, 61, . . . , 6q, di, . . . , and x, we have 

(ai, ...,ap, x){bi, . . . ,bq,x,di, . . . ,dr) = (61, . . . , &g, ai, . . . , Op, di, . . . , d^)- 



„(*) Ji) 



By this product rule, we represent Tr'^'-' as the one obtained by inserting rl 

before r^'' in the representation of tt^'"*"^). Since this insertion process is exactly the 
same as that in the definition of the map $, we obtain that tt*^^) is equal to </jo<i)(T). 
Here, for a permutation a, (p{(T) denotes the permutation consisting of the cycles 
of the word a according to RL-minima. Thus we get the following theorem. 

Theorem 5.1. The zigzag map is the same as (p o ^. 

For example, if T is the permutation tableau in Figure |S1 we have 

$(r) = 4, 6, 5, 2, 8, 3, 1, 9, 7, 12, 10, 11, 13, 

<f o $(r) = (4, 6, 5, 2, 8, 3, 1)(9, 7)(12, 10)(11)(13) = C'\T). 

Remark 5.1. Burstein [T] defined the bare representation of T G VT{n) to be 
the diagram obtained from T by replacing the topmost or the leftmost I's with 
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Figure 9. A zigzag map on the alternative representation of some 
T G rT{n). 

dots and removing the rest of the O's and I's, see Figure [8] In the same paper, 
he defined a map, say Q, on the bare representation by considering it as a binary 
forest. Similarly, one can check that </? o O is in fact the zigzag map on the bare 
representation. As Nadeau mentioned in [9], though not explicitly stated, one 
can obtain a bare representation from an alternative representation (of another 
permutation tableau) very easily: replace all the arrows with dots. Since there 
is exactly one t in each column and it is the topmost arrow, we can reconstruct 
the alternative representation. It is worth noting that although the three bijections 
^perm^ $ and 9 have very different descriptions, they are all zigzag maps on different 
representations. 

We can do the same thing for type B permutation tableaux. To state more 
precisely, we define the following. A zigzag path on the alternative representation 
of T £ 'P7~b("-) is defined in the same way with the obvious additional change of 
direction when we encounter the diagonal line, see Figure [9l Note that a zigzag 
path for T G 'PTb('t-) always starts from a row. 

For T G VTsin) and i G [n], we define ir = i '^f Column i has a t, and 
It = —i otherwise. Let R{T) — {It, 2^, . • . , "-t}- Note that R{T) is the set of 
integers appearing in the permutation $B(r). Then we define Cb*(^) ^'^ 
map TT : R{T) — >■ R{T) such that for each i G [n], if the zigzag path entering from 
Row i or Row —i exits T from Row j or Column j, then n^ix) — jr- It is easy to 
see that tt : R{T) — s- R{T) is a bijection. 

{1,2,-3,4,5,6,7,-8,9,10,11} 

-8 9 10 11 \ 
9 7 6 11 y ' 

where the bi- letter means that 7r(i) — j. 




Example 5.1. For T in Figure|9l we have R{T) 
and Ci^T) = TT : R{T) R(T) is the following 



(11) 



1 2 -3 4 5 6 7 
-3 1 5 4 -8 2 10 
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Note that we can identify Cb*(^) — ^ with an element in _B„ by reading the 
lower line in the two line notation of tt as shown in For example, the tt in 

PTjl is identified with -3, 1, 5, 4, -8, 2, 10, 9, 7, 6, 11 £ Bn. Thus Ci'* is a map from 
VTB.{n) to B„. 

We extend the definition of the map ip on Sn to i?„ as follows. For tt G 
Bn, we define <i5(7r) to be the permutation on the set of integers in tt consist- 
ing of the cycles of the word tt according to RL-minima. For example, if cr = 
9, 7, 10, 6, 2, 1, -3, 5, -8, 4, 11, then 

(/.((t) = (9,7,10,6,2,1,-3,5,-8)(4)(11). 



By the same argument used for proving Theorem 15.11 we obtain the following 
theorem. 

Theorem 5.2. The zigzag map 

Cb' : VTB{n)^B„ is the same as (p o ^g. 
For example, if T is the tableau in Figure [HI then 

$b(T) = 9, 7, 10, 6, 2, 1, -3, 5, -8, 4, 11, 
Ci'iT) = ip o <i>B(r) = (9, 7, 10, 6, 2, 1, -3, 5, -8)(4)(11). 

6. Further study 



In Corollary 13.81 we have found the following sign-imbalance formula for permu- 
tation tableaux: if n = 4fc + r for < r < 4, then 
(12) 

-I)'' ■22'=, ifr = Oorr=l, 

TeVT{n) 



(l+l)" + (l-i)" 



0, 



if r = 2, 
if r 3. 



Since we have obtained (1121) by putting t = —I in the generating function in The- 
orem [331 propose the following problem. 

Problem 6.1. Find a combinatorial proof of p^ . 

There is also a sign-imbalance formula for standard Young tableaux. The sign of 
a standard Young tableau T is defined to be the sign of the permutation obtained 
by reading T like a book. For example. 



sign 



1 


2 


5 


3 


4 





sign(12534) = 1. 



Stanley [14j conjectured the following sign-imbalance formula for standard Young 
tableaux: 

(13) J2 sign(T) = 2LtJ, 

Tesyr{n) 

where SyTin) is the set of standard Young tableaux with n squares. Lam [7] and 
Sjostrand [TT] independently proved and Kim [SJ Corollary 4.10 and Theorem 
4.13] generalized to skew standard Young tableaux. 

If we take the absolute values of p2)) and , we obtain the following somewhat 
unexpected result: if n ^ 2 mod 4, then 



(14) 



TGVr(,n) 



TesyT{n) 



= 2LfJ. 
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In (|14p taking the absolute value of the sign-imbalance for standard Young tableaux 
is only for an aesthetic reason. It will be interesting to find a combinatorial expla- 
nation for 

Since we do not have a type B analog for (jl2l) . we propose the following problem. 

Problem 6.2. Define the sign of a type B permutation tableau and find a sign- 
imbalance for type B permutation tableaux. 
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